ARDA Challenge Workshop 2004 An Investigation of Evaluation Metrics for Analytic Question Answering
نویسندگان
چکیده
منابع مشابه
New Directions in Question Answering
A dream since the first investigations into artificial intelligence has been to converse with a machine in natural language, in part to get answers to questions. Question answering (QA) promises an important new way of information access for all, a natural step beyond the keyword query and document retrieval of today’s web search. Several significant question answering activities currently unde...
متن کاملQuestion Answering Challenge for Five Ranked Answers and List Answers - Overview of NTCIR4 QAC2 Subtask 1 and 2
In this paper we describe an evaluation of question answering task, Question Answering Challenge 2 (QAC2). This evaluation project was first carried out at the NTCIR Workshop 3 in October 2002. One objective of the QAC was to develop practical QA systems in a general domain by focusing on research relating to user interaction and information extraction. Our second objective was to develop an ev...
متن کاملQuestion Answering Challenge for Information Access Dialogue - Overview of NTCIR4 QAC2 Subtask
We describe an overview of Question Answering Challenge (QAC) 2 Subtask 3, a novel challenge for evaluating open-domain question answering technologies, at the NTCIR Workshop 4. In QAC2 Subtask 3, question answering systems are supposed to be used interactively to answer a series of related questions, whereas in the conventional setting, systems answer isolated questions one by one. Such an int...
متن کاملNortheast Regional Research Center: Information Technology for Enhanced Analysis
The Advanced Research and Development Activity (ARDA) established the Northeast Regional Research Center (NRRC) to engage the best regional talent to create solutions to some of the most vexing challenges facing analysts today. Central to this new research model is a series of challenge workshops addressed by collaborative teams across industry, academia, and government. Workshops have made nov...
متن کاملQuestion Answering Challenge (QAC-1): An Evaluation of Question Answering Tasks at the NTCIR Workshop 3
In this paper we describe the Question Answering Challenge (QAC), a question answering task, and its first evaluation (QAC1). The project was carried out as a task of the NTCIR Workshop 3 in October 2002. One objective of the QAC was to develop practical QA systems in a general domain by focusing on research relating to user interaction and information extraction. Our second objective was to de...
متن کامل